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Description 

Method of Retrieving Information 
Associated with an Object Present in a 

Media Stream 

Cross Reference to Related Applications 

[0001] This application is a continuation-in-part of United States 

Patent Application No. 09/630,002, filed July 31, 2000. 
Background of Invention 

[0002] i) F i e |d 0 f t he Invention 

[0003] jhe subject invention relates to a method of retrieving in- 
formation associated with an object present in a media 
stream without editing the media stream. 

[0004] 2) Description of Related Art 

[0005] Society is increasingly becoming tired of traditional adver- 
tising and corporations are striving to find new methods 
of conveying information about their products. One ex- 
ample of the new methods of advertising is disclosed in 
the article entitled Tuned In, which appeared in the Au- 



gust 2003 issue of AMERICAN Way. The article describes a 
viewer of a NASCAR race being able to interact with his fa- 
vorite drivers competing in the race from his own living 
room or being able to allow the user to order items di- 
rectly through their television and have it delivered to 
their home. One problem with the general ideas described 
in the article is the cost required for providing such ser- 
vices and time and effort required to establish these ca- 
pabilities. To date, the industry has been unable to pro- 
vide a method of providing this functionality that is cost 
effective and that does not require extreme time and ef- 
fort. 

[0006] There are various methods of interacting with a media 
stream to obtain information, such as providing limited 
services. An example of such a method is disclosed in 
United States Patent No. 6,002,394 and United States 
Patent Application No. 20030005445, both to Schein et al. 
These references disclose an invention practiced under 
WebTV®, hereinafter referred to as interactive TV. The in- 
teractive TV provides a television schedule and informa- 
tion guide, which allows interaction between a television 
viewer and information associated with a television pro- 
gram. Two-way communication is established with an on- 



line internet provider. The on-line internet provider is 
used to provide information from broadcast stations and 
advertisers. The on-line internet provider supplies infor- 
mation concerning the television program, actors, prod- 
ucts related to the program, etc. in a product window. The 
link to the information is established between the infor- 
mation and the program itself. The information is only 
unique to the program the viewer chooses to select. How- 
ever, this method only provides superficial information to 
the viewer and the information is not being directly asso- 
ciated with objects in the media streams. Therefore, they 
have avoided expending great resources to establish their 
interactive television. This type of method is also com- 
monly provided by digital cable and satellite providers. 
[0007] other methods allow for creating hot spots for an object 
within a media stream and retrieving information associ- 
ated with the object upon selecting the hot spot. However, 
each of the methods known to those skilled in the art re- 
quire editing of individual frames of the media stream, 
which requires a significant outlay of the time and effort 
to establish such methods. Therefore, this technology has 
been slow to develop within the industry and very few 
would consider undertaking such a method. One method 



shown United States Patent Nos. 5,708,845 and 
6,496,981, both to Wistendahl et al., discloses creating 
hot spots for objects present in a media stream and asso- 
ciating information for the objects to the hot spots. This 
allows a user to select the hot spot to access the associ- 
ated information. Each of the "845 and the "981 patents 
requires editing of individual frames of the media stream 
to create the hot spots for the objects. It is well known to 
those skilled in the art to define hot spots using positional 
data having two or three coordinates. 
[0008] However, one issue presented in creating these hot spots 
is interleaving it with the media stream. Faced with this 
issued, these references disclose transmitting the hot 
spots in video blanking intervals (VBI) associated with the 
media stream. In other words, if the video is being trans- 
mitted at 30 frames per second, only about 22 frames ac- 
tually contain the media stream. This leaves 8 frames that 
are considered blank and one or two of these individual 
frames receives the hot spot data. Since the frames are 
passing at such a rate, the user or viewer upon seeing the 
hot spot and wishing to select it, will select it for a long 
enough period of time such that a blank frame having the 
hot spot data will pass during this period. The "845 patent 



and the "981 patent additionally disclose editing only se- 
lected frames of the media stream, instead of editing each 
of the individual frames. However, even if two frames per 
second were edited, for a half-hour media stream, 3,600 
frames would have to be edited. This would take consid- 
erable time and effort even for a most skilled editor. 
[0009] Another method disclosed in United States Patent No. 

6,154,771 to Rangan et al. incorporates hyperlinks into a 
media stream. The hyperlinks are created by a service 
provider and are edited into the individual frames of the 
media stream. The media stream is parsed and displayed 
as an array of static images for the user to see a past his- 
tory of the media stream. Editing the individual frames, as 
mentioned above, requires significant time, skill, and ef- 
fort and is a major burden to be overcome in providing 
this functionality to users and viewers in a cost effective 
manner. 

[0010] These related art methods are characterized by one or 
more inadequacies. Accordingly, it would be advanta- 
geous to provide a method that overcomes these inade- 
quacies by retrieving information for an object without 
editing the media stream. More specifically, it would be 
advantageous to provide these user-selectable regions, 



hot spots, or hyperlinks, without editing individual frames 
of the media stream such that it is economical and effi- 
cient. 

Summary of Invention 

[0011] The subject invention provides a method of retrieving in- 
formation associated with an object present in a media 
stream. The method includes the steps of defining a user- 
selectable region corresponding to the object in a layer 
separate from the media stream. The user-selectable re- 
gion is defined without accessing individual frames of the 
media stream. A link is defined to the information associ- 
ated with the object within the layer and is linked to the 
user-selectable region in the layer. The layer is disposed 
adjacent the media stream without interfering with play- 
back of the media stream and the user-selectable region 
is positioned in the layer over the object during playback 
of the media stream. While the media stream is playing, a 
user may select the user-selectable region from within the 
layer to access the information associated with the object 
in response to selecting the user-selectable region. 

[0012] The subject invention overcomes the inadequacies that 
characterize the related art methods. One aspect of the 
subject invention allows the user-selectable regions to be 



defined for any object in the media stream quickly and 
seamlessly without having to edit the individual frames of 
the media stream as required in the related art methods. 
The subject invention minimizes cost associated with cre- 
ating the user-selectable regions since the individual 
frames are not being edited which makes the technology 
economically feasible. Further, the subject invention al- 
lows for such quick defining and re-defining of the user- 
selectable regions that it may even be utilized for live 
broadcasts having a short time delay. Another aspect of 
the subject invention stores, tracks, and transmits selec- 
tions made by the user to allow for research gathering as 
it relates to the marketing and advertising for the object 

and for convenience of the user. 
Brief Description of Drawings 

[0013] other advantages of the present invention will be readily 
appreciated, as the same becomes better understood by 
reference to the following detailed description when con- 
sidered in connection with the accompanying drawings 
wherein: 

[0014] Figure 1 is an illustration of an editor having a media 
stream to be played and a layer for defining user- 
selectable regions therein; 



[0015] Figure 2 is an illustration of the editor having the user- 
selectable regions defined in the layer corresponding with 
objects present in the media stream; 

[0016] Figure 3 is an illustration of the editor defining links asso- 
ciated with each of the user-selectable regions linked to 
information associated with the objects; 

[0017] Figure 4 is an illustration of the editor re-defining the 

user-selectable regions in response to the objects chang- 
ing in size and location as the media stream is advanced; 

[0018] Figure 5 is an illustration of a player playing the media 

stream having the objects therein and the layer having the 
user-selectable regions associated with the objects dis- 
posed adjacent the media stream and having icons repre- 
senting the user-selectable regions with one icon being 
selected to access the associated information; 

[0019] Figure 6 is an illustration of the player and the layer with 
one of the user-selectable regions being selected and the 
associated information being displayed; 

[0020] Figure 7 is an illustration of the player having a deacti- 
vated user-selectable region in response to the object 
disappearing from the media stream; 

[0021] Figure 8 is an illustration of the player having the layer 
with user-selectable regions being selected to order an 



item; and 

[0022] Figure 9 is an illustration of a video signal having the me- 
dia stream and the layer with the user-selectable region 

transmitted therewith. 
Detailed Description 

[0023] a method of retrieving information 10 associated with an 
object 12 present in a media stream 14 is disclosed. The 
method may be performed on various types of devices 16 
such as, but not limited to, digital cable boxes, satellite 
receivers, TiVO recorders, personal video recorders, video 
cassette players/recorders, digital video disc players/ 
recorders, televisions, computers, and the like. Newer 
models of televisions may include internal hard drives and 
circuitry that allows for convenient practicing of the sub- 
ject invention. The method includes the step of accessing 
the information 10 during playback of the media stream 14 
on any of the devices 16 and also includes the step of 
defining user-selectable regions 18 in a layer 20 separate 
from the media stream 14. The layer 20 is preferably a 
clear applet that is displayed adjacent the media stream 
14 for receiving and storing the user-selectable regions 
18. The defining of the user-selectable region 18 is per- 
formed with an editor 22, which is typically separate from 



the devices 16 for playing the media stream 14. The editor 
22 may include a software program capable of playing the 
media stream 14 with the layer 20 disposed adjacent the 
media stream 14. The editor 22 is capable of defining 
user-selectable regions 18 within the layer 20 without 
editing the media stream 14, as described below. Refer- 
ring to Figures 1-4, a typical screen shot of the editor 22 
is shown. The user-selectable regions 18, commonly re- 
ferred to as hot-spots or hyperlinks are capable of being 
selected by a user or a viewer and performing a function, 
such as obtaining or displaying associated information 10, 
once selected. 

[0024] The user-selectable regions 18 may be defined by using 
computers or similar equipment running the editor 22. 
Referring to Figure 1, the layer 20 is disposed over the 
media stream 14 in the editor 22 while defining the user- 
selectable regions 18 such that the layer 20 is co- 
extensive with the media stream 14. The editor 22 is 
shown modifying the contrast between the layer 20 and 
the media stream 14 to assist in defining the user- 
selectable regions 18. If the media stream 14 is played at 
full screen resolution, the layer 20 is sized to fit the media 
stream 14. In other words, the layer 20 is adaptable to var- 



ious sized windows or screen sizes. However, the layer 20 
may be re-sized in relation to the size of the media 
stream 14 such that the user-selectable regions 18 remain 
associated with the object 12. The media stream 14 in- 
cludes the object 12 therein, which will assist in defining 
the user-selectable regions 18. The media stream 14 in- 
cludes, but is not limited to, recorded or live television 
programs, movies, sporting events, game shows, adver- 
tisements, video games and the like. As illustrated in the 
Figures, but in no way limiting, the media stream 14 is il- 
lustrated as a news broadcast. The subject invention may 
be utilized on live shows that are delayed for a short pe- 
riod of time to allow for the defining of the user-se- 
lectable regions 18. Typically, these media streams 14 are 
captured on film at many frames per second, such as be- 
tween 10 frames per second and 30 frames per second. 
Therefore, in a half-hour media stream 14, there may be 
as many as 108,000 frames. However, it is to be appreci- 
ated that the media stream 14 may have more or less 
frames per second depending upon the particular 
medium. Further, these media streams 14 may include 
digitally created and re-mastered media streams 14 that 
may be played on any of the above devices 16. 



[0025] The objects 12 may be placed in the media stream 14 for 
brand awareness, which is typically referred to as product 
placement or integration. To date and with traditional 
product placement, the viewer is only able to view the 
products without obtaining any information 10 associated 
with the object 12. Examples of product placement include 
placing the product in television programs so those view- 
ers of the television program will see the products and 
advertising at venues hosting sporting events such that 
their advertisements are displayed during the broadcast of 
the sporting event. However, the user watching the media 
stream 14 is unable to access information 10 associated 
with the object 12 present in the media stream 14. For ex- 
ample, if a character in a movie 42 is wearing a particular 
outfit and the viewer is interested in the outfit, the viewer 
is unable to obtain information 10 associated with the 
particular outfit by interacting with the device. 

[0026] Those skilled in the art shall recognize that the type of 

object 12 is not limited, and may be any item in the media 
stream 14. Examples of suitable objects 12 include, but are 
not limited to, clothes, food items, furniture, corporate 
logos, vehicles, locations, buildings, and the like. Each 
one of these objects 12 may have information 10 associ- 



ated with the object 12. In other words, if the food item is 
a pizza 24, the associated information 10 may include 
pizzeria information ll that is local to the viewer, such as 
telephone numbers, menus, location, etc., as illustrated in 
Figure 8. If the object 12 is a location, then the associated 
information 10 may include population, average weather 
conditions for the time of year, etc. Referring back to Fig- 
ures 1-7, the objects 12 are a network logo 26, a flag 28, a 
pair of glasses 30, and a suit 32. The media stream 14 is 
played in a player and is displayed on a screen to the 
viewer. The player may be any of the devices 16 listed 
above or it may be another piece of software stored on 
the device, such as, but not limited to, Real Player or Me- 
dia Player on the computer. As the media stream 14 is 
played at the desired frames per second, the object 12 
may move across the picture from one frame to another. 
[0027] The user-selectable region 18 is defined within the layer 
20, which is separate from the media stream 14 and corre- 
sponds to the object 12 in the media stream 14. The user- 
selectable region 18 is defined without accessing individ- 
ual frames of the media stream 14. Referring to Figure 2, 
the user-selectable regions iSare defined during real 
time playback of the media stream 14 in the editor 22. In 



this method, a first point in the media stream 14 is desig- 
nated as a starting point and a second point is designated 
as the ending point. The starting and the ending point 
may correspond to the beginning and ending of the media 
stream 14 or the media stream 14 may be divided into 
shorter segments depending upon the length of the media 
stream 14 or the number of user-selectable regions 18 
therein. However, it is to be appreciated that it may be 
broken into smaller segments if storage capacity or band- 
width of the devices 16 or the players are at issue. 
[0028] one possible way to define the user-selectable region 18 
is by using positional information based upon a position 
and size of the object 12 present in the media stream 14 at 
the starting point. The media stream 14 is loaded into the 
editor 22 and stopped at the starting point. For any de- 
sired object 12 in the media stream 14, the user-selectable 
region 18 is defined by outlining the object 12 within the 
layer 20. In Figure 2, the logo 26, the flag 28, the glasses 
30, and the suit 32 are shown being outlined to define the 
user-selectable regions 18. The user-selectable region 18 
is essentially a closed spline having multiple vertices that 
define the user-selectable region 18. One way to define 
the user-selectable regions 18 \s to draw with an input 



tool an outline about the object 12 creating the closed 
spline. The vertices of the outline are then transformed 
into positional information/data, such as X and Y coordi- 
nates, for the object 12 at the starting point. The user- 
selectable region 18 may be defined as any size and shape 
and is only limited by the object 12 located in the media 
stream 14. 

[0029] The media stream 14 is then advanced forward, i.e. played 
or fast-forwarded. Referring to Figure 4, the media stream 
14 has been advanced to include another person in the 
media stream 14. The closed spline may be re-defined as 
the object 12 changes location and size through out the 
media stream 14 and the positional information is contin- 
uously updated creating mapping data for the object 12. 
Re-defining the user-selectable region 18 may be accom- 
plished by clicking and dragging the closed spline to fit 
the size and location of the object 12. In Figure 4, the 
user-selectable regions 18 have been reduced to corre- 
spond with the size of the objects 12. As the user- 
selectable region 18 is re-defined, the mapping data is 
continuously updated. 

[0030] The positional data generally refers to the outline at the 
starting and ending points, while the mapping data refers 



to the movement of the user-selectable region 18 through 
out and for the length of the media stream 14. Those 
skilled in the art would understand that positional data 
and mapping data generally relate to the same informa- 
tion at different times. Once the ending point of the media 
stream 14 is reached, the object 12 has been tracked and 
the positional data for the user-selectable region 18 has 
been defined for the length of the media stream 14. The 
mapping data may then be stored and the positional data 
is associated with the staring and ending point of the me- 
dia stream 14. If there are multiple objects 12 in the media 
stream 14, then a plurality of user-selectable regions 18 
may be disposed in the layer 20 corresponding to each of 
the plurality of objects 12 and each of the plurality of 
user-selectable regions 18 would have corresponding po- 
sitional data. 

[0031] Alternatively, another method to define the user-se- 
lectable region 18 may be based upon a time period that 
the object 12 is in one location during playback and then 
synchronizing the user-selectable region 18 within the 
layer 20 as the object 12 moves in time. The user- 
selectable region 18 is defined as described above for the 
starting point having the positional data. As the media 



stream 14 is advanced, the time period that the object 12 
remains in that position in the media stream 14 is 
recorded. The time period and the user-selectable region 
18 are then synchronized such that the user-selectable 
region 18 is displayed at that positional data within the 
layer 20 for the time period. The time period essentially 
replaces the mapping data in the method described 
above. This allows the user-selectable region 18 to be se- 
lected to access the object information 10. It is to be ap- 
preciated that those skilled in the art would recognize ad- 
ditional ways to define the user-selectable regions 18 
other than as described based on time and position. 
[0032] As described above and shown in Figure 4, the user- 
selectable region 18 is capable of being re-defined. It is to 
be appreciated that re-defining includes enlarging or re- 
ducing the user-selectable region 18 for the object 12 
within the layer 20 in response to the size of the object 12 
becoming larger or smaller within the media stream 14. 
The user-selectable region 18 may also be removed alto- 
gether in response to the object 12 disappearing from the 
media stream 14. In Figure 5, the network logo 26 initially 
had a user-selectable region 18 defined, but since the 
logo 26 has disappeared from the media stream 14, so has 



the user-selectable region 18 disappeared from the layer 
20. Alternatively, if the object 12 disappears, the user- 
selectable region 18 may remain in the layer 20, but it 
would be deactivated. Referring to Figure 7, the user- 
selectable region 18 for the logo 26 has been deactivated 
because the logo 26 has disappeared from the media 
stream 14. When the object 12 reappears in the media 
stream 14, the user-selectable region 18 would be re- 
created or reactivated. The re-defining of the user- 
selectable region 18 may be accomplished either through 
manual manipulation of the user-selectable regions 18 or 
through automatic detection of the objects 12. 
[0033] | n order to automatically define and re-define the user- 
selectable regions 18, the editor 22 may also include a de- 
tector (not shown). The detector may be integrally formed 
with the editor 22 as an additional component of the soft- 
ware. The detector monitors and detects an identifying 
characteristic for the object 12 with the layer 20. As de- 
scribed above, the position and/or the size of the object 
12 may change throughout the media stream 14. The de- 
tector detects the movement of the object 12 within the 
media stream 14 and re-defines the user-selectable re- 
gion 18 as necessary and without outside involvement. 



The movement may be detected based upon a change in 
an identifying characteristic and re-defining the user- 
selectable region 18 within the layer 20 in response to de- 
tecting the change of the identifying characteristic. A 
most preferred method would be to automatically detect 
the change and automatically re-define the user-se- 
lectable region 18 within the layer 20 in response to auto- 
matically detecting the change. One of way detecting 
movement or changes in the object 12 would be to moni- 
tor a color palette or a predetermined symbol. 
[0034] For example, if the network logo 26 is present in the me- 
dia stream 14, the detector might look for that logo 26 and 
define the user-selectable region 18 accordingly. If the 
logo 26 disappears from the screen, the user-selectable 
region 18 may disappear or become disabled. If an icon 36 
for the logo 26 was present in the layer 20, it may also 
disappear in response to the logo 26 disappearing from 
the media stream 14 or it may become darkened as is 
common to indicate deactivation. Further, the detector 
may watch for the particular color palette and re-define 
the user-selectable region 18 in response to it changing. 
This would be particularly useful for sporting events, 
where each team has their own jersey being a particular 



color of the color palette. 
[0035] Referring back to Figure 3, after the user-selectable re- 
gions 18 have been defined, a link 34 is associated be- 
tween the user-selectable region 18 and the information 
10 associated with the object 12. The link 34 is established 
in the editor 22 by selecting the user-selectable region 18 
and inputting a location for the information 10. The link 34 
is the location where the information 10 associated with 
the object 12 is stored. The link 34 may be an IP address, a 
file location, and the like. The link 34 is linked with the 
user-selectable region 18 such that when the user selects 
the user-selectable regions 18, the link 34 is accessed and 
the information 10 is then displayed. Once the link 34 and 
the user-selectable regions 18 are associated, a file is cre- 
ated and stored containing the links and the positional 
data, mapping data, or time, for the user-selectable re- 
gions 18. The file is executed in the layer 20 during the 
playback of the media stream 14 in the player to display 
the user-selectable regions 18, as will be further de- 
scribed below. 

[0036] it is to be appreciated by those skilled in the art that the 
media stream 14 is played or advanced in the editor 22 
while the defining and re-defining of the user-selectable 



region 18 is on going in the layer 20. The play back of the 
media stream 14 is significantly different than accessing 
individual frames of the media stream 14. Playing the me- 
dia stream 14 is based on time and not individual frames. 
It requires significant time, effort, and skill to edit individ- 
ual frames of the media stream 14 and would make defin- 
ing and re-defining user-selectable regions 18 nearly im- 
practical. When editing individual frames, the resultant file 
having the edited frames requires large amounts of stor- 
age because of the large volume of information 10 re- 
quired for each of the frames. As set forth above, editing 
a half-hour media stream 14 would require editing 
108,000 individual frames. 
[0037] Further, even to edit selected individual frames of the me- 

rd th 

dia stream 14, such as every 3 or 5 frame, would take 

th 

considerable time and effort. If only every 5 frame is 
edited, it would require editing 21,600 frames. The file 
containing the data associated with this large number of 
frames is costly to store, transmit, and reproduce. The 
subject invention does not require editing individual 
frames and instead is based upon the length and time of 
the media stream 14. Additionally, since the user- 
selectable regions 18 can be defined by advancing the 



media stream 14 at a faster play back rate than a normal 
playback rate, a half-hour media stream 14 may take 
much less than half an hour to define the user-selectable 
regions 18 therein. The file containing the links and user- 
selectable regions 18 is smaller, which significantly re- 
duces the time and effort required, as well as the cost to 
store, transmit, and reproduce the data. 

[0038] The user-selectable regions 18 may be present in the layer 
20 for the entire length of the media stream 14, subject to 
the object 12 being present therein. Said another way, the 
user-selectable regions iSaren"t present for one frame 
and gone the next frame, so long as the object 12 remains 
in the media stream 14. Since the subject invention does 
not edit individual frames of the media stream 14, the 
user-selectable regions 18 are continuously present when 
the objects 12 are present. This is distinguishable from 
the prior methods that edit individual frames of the media 
stream 14 and input the user-selectable regions 18 every 
few frames to save time and bandwidth. 

[0039] when the user-selectable region 18 is present in the layer 
20, an icon 36 may be disposed in the layer 20 to indicate 
to the user that user-selectable regions 18 are available to 
be selected. The user may use any controls to select either 



one of the icons 36 or the user-selectable regions 18. For 
example, but in no way limiting, the user may use a re- 
mote control 38 (see Figure 8) as an input device to move 
between user-selectable regions 18 and select it by press- 
ing a particular key. The indicator for the user-selectable 
regions 18 may also be incorporated directly into the re- 
mote control 38. In another example, the user may navi- 
gate by a mouse (not shown), either wired or wireless. The 
mouse and/or the remote control 38 may operate by in- 
frared, radio frequency or the like. Alternatively, if the 
user-selectable region 18 is within the layer 20, the icon 36 
may automatically be highlighted, so the user only has to 
press the particular key to access the information 10. Ad- 
ditional indicators other than as described may be present 
to inform the user that the user-selectable regions 18 are 
enabled and that they may access the information 10 as- 
sociated with the object 12. 
[0040] | n operation, the layer 20 is disposed adjacent the media 
stream 14 without interfering with playback of the media 
stream 14 in the player, as illustrated in Figures 5-8. Since 
the layer 20 is preferably a clear applet, it can overlay the 
player and the media stream 14 without interfering with 
playback. The file containing the user-selectable regions 



18 and links is retrieved within the layer 20 and queued to 
the starting point associated with the media stream 14. 
The media stream 14 is then played in the player and the 
user-selectable regions 18 are positioned within the layer 
20 and correspond to the object 12 as described above. 
The user may then select the user-selectable region 18 
from within the layer 20 during playback of the media 
stream 14 by either selecting the region 18 or the icon 36, 
if present. The information 10 that is associated with the 
object 12 is accessed in response to selecting the user- 
selectable region 18 from within the layer 20. As shown in 
Figure 5, selecting the icon 36 of the suit 32 displays the 
information 10 for the suit. Likewise, in Figure 6, the user- 
selectable region 18 for the flag 28 is selected and the in- 
formation 10 is displayed for the flag 28. 
[0041] various methods may be used to retrieve the file for dis- 
playing in the layer 20. One such method, but not limited 
to, utilizes meta data available in the media stream 14. 
The meta data is essentially open space present in the 
media stream 14 that can store tasks to be performed, 
trigger other functions, or take actions prior to playing the 
media stream 14. The meta data is typically located at the 
very beginning of the media stream 14. One action that 



may be triggered by the meta data is to obtain the file 
containing the user-selectable regions 18. The subject in- 
vention would reference the location of the file in the 
meta data. In this manner, the media stream 14 would be 
read by the player, the file containing information 10 for 
the user-selectable regions 18 is retrieved, and the infor- 
mation 10 loaded into the player. The file is capable of be- 
ing stored in various locations so long as it is accessible 
by the device playing the media stream 14. This may in- 
clude servers provided by the provider of the media 
stream 14 or separate from the provider, such as the 
provider of the layer 20. It is to be appreciated that those 
skilled in the art may devise alternate methods of retriev- 
ing the file than as described above, such as transmitting 
the file directly with the media stream 14. 
[0042] Once the user-selectable region 18 is selected, the media 
stream 14 may be stopped and the information 10 may 
then be displayed or the media stream 14 may continue to 
play while the information 10 is displayed. In either sce- 
nario, the information 10 may be displayed in any one of 
the layer 20, the player, and a window separate from the 
layer 20 and the player, such as transmitting the file di- 
rectly with the media stream 14. 



[0043] one advantage of the subject invention is that it allows for 
two-way communication to be established between the 
user interacting with the layer 20 and a provider transmit- 
ting a video signal 40 having the media stream 14 and the 
layer 20. Referring to Figure 9, the video signal 40 is illus- 
trated as including the media stream 14 as a movie 42, a 
channel logo 26 to be imposed over the movie 42, a chan- 
nel guide feature 44, and the layer 20. The provider can 
then detect how often the objects 12 are selected and this 
in turn would allow them to adjust the cost of advertising 
within the media stream 14. Further, the collection of the 
user data may be retained for future interaction and may 
even allow the provider to tailor the user-selectable re- 
gions 18 to the individual user based upon past selections. 
The user-selectable regions 18 that are selected may also 
be tracked and transmitted to either the provider or the 
producer of the object 12 for instantaneous feedback of 
the marketing and advertising. 

[0044] Another advantage of the subject invention is that is may 
be incorporated into existing systems without any addi- 
tional hardware and minimal, if any, additional software. 
Currently, providers supply the video signal 40 to the user 
and the video signal 40 includes a first component having 



the media stream 14 therein. The subject invention would 
therefore include transmitting a second component with 
the video signal 40 having the layer 20 with the user- 
selectable regions 18 corresponding to objects 12 present 
in the media stream 14 and linked to information 10 asso- 
ciated with the object 12. As described above, the media 
stream 14 may include the location of the file to be dis- 
played in the layer 20. Often, as is the case with digital ca- 
ble, other components may be transmitted as a part of the 
video signal 40. The other components may include such 
features as video on demand, television channel guides, 
and the like. The existing equipment would receive both 
the first and the second component of the video signal 40. 
The player would play the media stream 14 and the layer 
20 would be disposed adjacent the player. The user may 
even be unaware that the layer 20 is disposed adjacent the 
media stream 14, since it does not interfere with the play- 
back. Once the media stream 14 is played, the user has 
the ability to interact with the layer 20 and access the ob- 
ject information 10. 
[0045] obviously, many modifications and variations of the 

present invention are possible in light of the above teach- 
ings. The invention may be practiced otherwise than as 



specifically described within the scope of the appended 
claims. In addition, the reference numerals in the claims 
are merely for convenience and are not to be read in any 
way as limiting. 



